Images tagged with "reinforcement learning"

Found 18 images.

ID Name Collection(s) Description
60323 Immediate reversals with instructions: Instructed Group learners Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala This analysis identifies regions that show immediate reversals with instructions (CS [previous CS+ > previous CS-] x Phase [Pre - Post] interaction) in the Instructed Group, based on the window surrounding the delivery of instructions. Regions in warm colors showed greater activation to the current CS+ relative to the current CS-, while regions in cool colors show relatively greater activation to the CS- (or deactivation to the CS+). This analysis was restricted to Instructed Group learners, or those individuals who showed differential SCR prior to the first reversal (n = 20).
60324 Immediate reversals with instructions: Instructed Group (all participants) Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala This analysis identifies regions that show immediate reversals with instructions (CS [previous CS+ > previous CS-] x Phase [Pre - Post] interaction) in the Instructed Group, based on the window surrounding the delivery of instructions. Regions in warm colors showed greater activation to the current CS+ relative to the current CS-, while regions in cool colors show relatively greater activation to the CS- (or deactivation to the CS+). This analysis was included all Instructed Group participants (n=30), irrespective of whether they showed differential SCR prior to the first reversal.
60325 No reversal with instructions: Instructed Group learners Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala No reversal with instructions (main effect of CS without interaction; i.e. [previous CS+ > previous CS-] ∪ [new CS- > new CS+]). Regions that show no evidence for reversal when instructions are delivered, based on continued differential responses pre- and post-instruction. Regions in warm colors showed greater activation to the pre-instruction CS+ relative to the CS- both pre- and post-instruction, while regions in cool colors show relatively greater activation to the CS- (or deactivation to the CS+). Map depicts t-test across learners, or those individuals who showed differential SCR prior to the first reversal (n = 20).
510285 NADs P(A)-modulated activity vs implicit baseline Language statistical learning responds to reinforcement learning principles rooted in the striatum Fig 4. Brain regions related to changes in the predictive value of the initial word of each phrase in the NADs block vs. implicit baseline (i.e., NADs P(A)-modulated activity vs. implicit baseline). Activity in the Basal ganglia (bilateral caudate nuclei, putamen, and ventral striatum) and in the left posterior superior temporal gyrus (STG) was modulated the trial-by-trial development of predictions (P(A)) as estimated by the TD model (contrast: NADs P(A) - Baseline). Results are reported for clusters FWE-corrected at p < 0.001 at the cluster level (minimum cluster size = 20; p<0.001 uncorrected at the voxel level). Neurological convention is used with MNI coordinates shown at the bottom right of each slice.
60326 No reversal with instructions: Entire Instructed Group Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala No reversal with instructions (main effect of CS without interaction; i.e. [previous CS+ > previous CS-] ∪ [new CS- > new CS+]). Regions that show no evidence for reversal when instructions are delivered, based on continued differential responses pre- and post-instruction. Regions in warm colors showed greater activation to the pre-instruction CS+ relative to the CS- both pre- and post-instruction, while regions in cool colors show relatively greater activation to the CS- (or deactivation to the CS+). Map depicts t-test across all Instructed Group participants (n=30), irrespective of whether subjects displayed differential SCR prior to the first reversal.
60327 Correlations between Instructed Reversal (rho) parameter and instructed reversals Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala Correlations with instructed reversal (ρ) parameters. Brain-behavior correlations tested for correlations between each individual’s ρ parameter (based on within-subjects fits) and the magnitude of the reversal effect (CS x Phase interaction) using robust regression. Regions in warm colors show positive correlations between the magnitude of the instructed reversal parameter and the strength of reversal (Top) or sustained differential response (Bottom) in the region, while regions in cool colors show negative correlations. This analysis was restricted to Instructed Group learners (n = 20) who showed differential SCR prior to the first reversal.
42708 Connectivity between ventral striatum generalization ROI and whole brain Generalization of value in reinforcement learning by humans Correlation (PPI main effect) of right ventral striatum generalization ROI with activity across the whole brain during trials.
60317 Feedback-driven expected value: Uninstructed Group Learners Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala This corresponds to Figure 3: Figure supplement 1. We fit a computational model to SCR in the Uninstructed Group during our fear reversal learning task, and measured within-subject correlations with brain responses to unreinforced CS presentations (trial-by-trial). Robust regression was used to generate group results. These results are restricted to the 20 uninstructed subjects who showed differential SCR prior to the first reversal.
60328 Correlations between Instructed Reversal (rho) parameter and no reversal with instructions Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala Correlations with instructed reversal (ρ) parameters. Brain-behavior correlations tested for correlations between each individual’s ρ parameter (based on within-subjects fits) and the absence of instructed reversal (main effect of CS without reversal) using robust regression. Regions in warm colors show positive correlations between the magnitude of the instructed reversal parameter and the sustained differential response in the region, while regions in cool colors show negative correlations. This analysis was restricted to Instructed Group learners (n = 20) who showed differential SCR prior to the first reversal.
60318 Feedback-driven expected value: Uninstructed Group (All subjects) Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala This corresponds to Figure 3: Figure supplement 1. We fit a computational model to SCR in the Uninstructed Group during our fear reversal learning task, and measured within-subject correlations with brain responses to unreinforced CS presentations (trial-by-trial). Robust regression was used to generate group results. These results include all 40 uninstructed subjects, including those who did and did not exhibit differential SCR prior to the first reversal.
42709 Generalization behavioral benefit correlation with ventral striatum - whole-brain connectivity Generalization of value in reinforcement learning by humans Correlation of right ventral striatum ROI connectivity (PPI trial main effect) and individual differences in model fit (likelihood) due to generalization.
60319 Instruction-based expected value: Instructed Learners Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala This corresponds to Figure 3: Figure supplement 2. We fit our modified computational model (which flexibly updates when instructed reversals are delivered) to SCR in the Instructed Group learners during our fear reversal learning task. We measured within-subject correlations with brain responses to unreinforced CS presentations (trial-by-trial). Robust regression was used to generate group results. These results are restricted to the 20 Instructed Group subjects who showed differential SCR prior to the first reversal.
60320 Instruction-based expected value: Instructed Group (all subjects) Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala Description: This corresponds to Figure 3: Figure supplement 2. We fit our modified computational model (which flexibly updates when instructed reversals are delivered) to SCR in the Instructed Group learners during our fear reversal learning task. We measured within-subject correlations with brain responses to unreinforced CS presentations (trial-by-trial). Robust regression was used to generate group results. These results include all Instructed Group participants (n=30), whether or not they showed differential SCR prior to the first reversal.
18860 Reward prediction error Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis Reward prediction error (main effect)
60321 Feedback-driven vs Instruction-based expected value within Instructed Group learners Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala Direct comparison between feedback-driven and instruction based EV signaling within the Instructed Group. Feedback-driven EV is based on the model fit to the Uninstructed Group learners, while instruction-based EV is based on fit to the Instructed Group learners. Orthogonalization was disabled in first-level analyses, and these results are robust regression across the contrast values. Regions in warm colors showed preferential correlations with feedback-driven EV, while regions in cool colors showed higher correlations with instruction-based EV. Analysis is restricted to learners, or those individuals who showed differential SCR prior to the first reversal (n = 20).
18861 Conjunction (6 studies) Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis Conjunction of all sub-contrasts (aside from smoothing)
18862 Expected Value Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis Expected Value contrast.
60322 Feedback-driven vs Instruction-based expected value: All Instructed Group participants Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala Direct comparison between feedback-driven and instruction based EV signaling within the Instructed Group. Feedback-driven EV is based on the model fit to the Uninstructed Group learners, while instruction-based EV is based on fit to the Instructed Group learners. Orthogonalization was disabled in first-level analyses, and these results are robust regression across the contrast values. Regions in warm colors showed preferential correlations with feedback-driven EV, while regions in cool colors showed higher correlations with instruction-based EV. Analysis includes entire Instructed Group (n=30), irrespective of whether participants showed differential SCR prior to the first reversal.